ON GEOMETRIC PROBLEMS RELATED TO 
BROWN- YORK AND LIU-YAU QUASILOCAL MASS 



PENGZI MIAO\ YUGUANG SHI^ AND LUEN-FAI TAM^ 

Abstract. We discuss some geometric problems related to the 
definitions of quasilocal mass proposed by Brown- York [5j [5] and 
Liu-Yau [13] [H] . Our discussion consists of three parts. In the first 
part, we propose a new variational problem on compact manifolds 
with boundary, which is motivated by the study of Brown- York 
mass. We prove that critical points of this variation problem are 
exactly static metrics. In the second part, we derive a derivative 
formula for the Brown- York mass of a smooth family of closed 
2 dimensional surfaces evolving in an ambient three dimensional 
manifold. As an interesting by-product, we are able to write the 
ADM mass [1] of an asymptotically flat 3-manifold as the sum of 
the Brown- York mass of a coordinate sphere Sr and an integral 
of the scalar curvature plus a geometrically constructed function 
^(x) in the asymptotic region outside Sr- In the third part, we 
prove that for any closed, spacelike, 2-surface E in the Minkowski 
space K.'^^^ for which the Liu-Yau mass is defined, if E bounds a 
compact spacelike hypersurface in M.^'^, then the Liu-Yau mass of 
E is strictly positive unless E lies on a hyperplane. We also show 
that the examples given by O Murchadha, Szabados and Tod [18] 
are special cases of this result. 



1. Introduction 

In this work, we will discuss some geometric problems related to the 
definitions of quasilocal mass proposed by Brown- York [5] [6] and Liu- 
Yau [i3\ pL4j- In general, there are certain properties that a reasonable 
definition of quasilocal mass should satisfy, see [21] for example. The 
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most important property is the positivity. There are results on posi- 
tivity of Brown- York mass and Liu-Yau mass in [121 [HI [221 EOl [23] • In 
particular, the following is a consequence on the positivity of Brown- 
York mass proved by the last two authors in [19] . Let be the standard 
Euclidean metric on M^. Let be a bounded strictly convex domain 
in with smooth boundary S which has mean curvature Hq. Then 

Hoda is a maximum of the functional jj, Hda on the class of smooth 
metrics with nonnegative scalar curvature on Q which agree with ge 
tangentially on S and have positive boundary mean curvature H. It is 
interesting to see if this is still true for general domains in M^. 

In [20], a similar result was proved for domains in H^, the hyperbolic 
3-space. Namely, it was proved that if gt is the standard hyperbolic 
metric on and is a bounded domain with strictly convex smooth 
boundary S which is a topological sphere and has mean curvature Hq, 
then Jj, Hq cosh rda is a maximum of the functional jj. H cosh rda on 
the class of smooth metrics with scalar curvature bounded below by 
—6 which agree with g^ tangentially on S and have positive boundary 
mean curvature H. Here r is the distance function on from a fixed 
point in Q. Again it is interesting to see if this is still true for general 
domains in H'^. 

The results and questions above motivate us to study the functional 

F^{g) = j^H(P da, 

where S is the boundary of an n dimensional compact manifold Q, cj) 
is a given smooth nontrivial function (that is ^ 0) on S, and da is 
the volume form of a fixed metric 7 on E. The class of metrics g we 
are interested is the space of metrics with constant scalar curvature K 
which induce the metric 7 on S. In Theorem I2.H we will prove the 
following: g is a critical point of F^{-) if and only if g is a static metric 
with a static potential N that equals (p on T,. That is to say: 

( -{AgN)g + VlN - NRic{g) = 0, on n 
\ N = (p, atE. 

In the theorem, for K > 0, we also assume that the first Dirichlet 
eigenvalue of (n — l)Ag + Kis positive. 

In particular, if (p = 1, K = and n = 3, we can conclude that g is 
a critical point of j^, H da if and only if is a flat metric. 

Another important question on quasilocal mass is whether it has 
some monotonicity property. In [19] , it was shown that the Brown- York 
mass of the boundaries of certain domains in a space with some qausi- 
spherical metric is monotonically decreasing rather than increasing as 
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the domains become larger. In Theorem 13.11 we will derive a more 
general formula for the derivative of the Brown- York mass of a smooth 
family of surfaces with positive Gaussian curvature which evolve in an 
ambient manifold. The formula gives a generalization of the monotonic- 
ity formula in ^9J which plays a key role in the proof of the positivity 
of Brown- York mass. As an interesting by-product of this derivative 
formula, in Corollary 13.51 we are able to write the ADM mass [1] of an 
asymptotically flat 3-manifold as the sum of the Brown- York mass of a 
coordinate sphere Sr and an integral of the scalar curvature plus a ge- 
ometrically constructed function $(x) in the asymptotic region outside 

The Minkowski space M^'^ represents the zero energy state in general 
relativity. Thus, a reasonable notion of quasilocal mass should be such 
that its value of a spacelike 2-surface in R^'^ equals zero. In [131 fl^ - 
the Liu-Yau mass was introduced and its positivity was proved. In 
the time symmetric case, this coincides with the Brown- York mass. 
However, O. Murchadha, Szabados and Tod [18] constructed spacelike 
2-surfaces S with spacelike mean curvature vector H in M^'^ and with 
positive Gaussian curvature such that the Liu-Yau mass of S given by 

m,,(S) = ^ / {H,-\H\)da 

is strictly positive. Here Hq is the mean curvature of S when isomet- 
rically embedded in and is the Lorentzian norm of H in M^'^. 
Recently, Wang and Yau [221 [23] introduce another definition of quasilo- 
cal mass to address this question. In Theorem 14. II in this paper, we will 
prove the following: Let J] be a closed, connected, spacelike 2-surface in 
the Minkowski space M^'^ with spacelike mean curvature vector and with 
positive Gaussian curvature. Suppose S spans a compact, spacelike hy- 
persurface inM.^'^, then the Liu-Yau mass ofT, is strictly positive, unless 
S lies on a hyperplane. The results give some properties on isometric 
embeddings of compact surfaces with positive Gaussian curvature in 
the Minkowski space. We will also show that all the examples in [18] 
satisfy the conditions in Theorem 14.11 

This paper is organized as follows. In section 2, we will prove that 
static metrics are the only critical points of the functional F^{-). In 
section 3, a formula for the derivative of the Brown- York mass will be 
derived and some applications will be given. In section 4, we will prove 
that for "most" spacelike 2-surfaces in M^'^ for which the Liu-Yau mass 
is defined, their Liu-Yau mass is strictly positive. In the appendix, we 
prove some results on the differentiability of a 1-parameter family of 
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isometric embeddings in M^, following the arguments of Nirenberg [T7]. 
The results will be used in section 3. 

We would like to thank Robert Bartnik for useful discussions on the 
existence of maximal surfaces. 

2. STATIC METRICS AND BROWN-YORK TYPE INTEGRAL 

Throughout this section, we let Q be an n-dimensional (n > 3) com- 
pact manifold with smooth boundary E. Let 7 be a smooth Riemannian 
metric on S. As in [16], for a constant K and any integer k > ^ + 2, 
we let be the set of W^'"^ metrics g on Q with constant scalar 
curvature K such that 5'|r(s) =7- H g & Ml^ and the first Dirichlet 
eigenvalue of {n — l)Ag + K is positive, where is the usual Laplacian 
operator of g, then Aii^ is a manifold near g (see |l6j for detail). Let 
be a given smooth function on E, we define the following functional 
on M^: 

(2.1) F^{g) = [ H,(f) da, 

Jt. 

where Hg is the mean curvature of S in (f2, g) with respect to the 
outward unit normal and da is the volume form of 7. Motivated by 
the results in [20] on the positivity of Brown- York mass and some 
generalization, we want to determine the critical points of F^{-) on M.^ . 

Before we state the main result, we recall the following definition 
from f7]: 

Definition 2.1. A metric g on an open set U is called a static metric 
on U if there exists a nontrivial function N (called the static potential) 
on U such that 

(2.2) - {AgN)g + V^N - NRic{g) = 0. 

Here A^, are the usual Laplacian, Hessian operator of g and Ric(5') 
is the Ricci curvature of g. 

A basic property of static metrics is that they are necessarily metrics 
of constant scalar curvature [Tf Proposition 2.3]. 

In the following, we obtain a characterization of static metrics in 
using the function F^{-). 

Theorem 2.1. With the above notations, let (p be a nontrivial smooth 
function on S. Suppose g e A4i^ such that the first Dirichlet eigenvalue 
of {n — 1) Ag + K is positive. Then g is a critical point of F^{-) defined 
in (12. ip if and only if g is a static metric with a static potential N such 
that N = (f) onTj. 
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Proof. Since the Dirichlet eigenvalue of (n — l)Ag + K is positive, we 
know A^:^ is a manifold near g by the result in [T6] . 

First, we suppose g is a static metric with a potential N such that 
iV = on S. Let g{t) be a smooth curve in A^?' with g{0) = g. Let 



F{t) = j H{t)(t) da, 



where H{t) is the mean curvature of S in {Q,g{t)) with respect to the 
outward unit normal u. Let " ' " denote the derivative with respect to t. 
We want to prove that F'{0) = 0. Let h = g'{0). In what follows, we let 
ujn denote the outward unit normal part of a 1-form u, i.e. u;„ = uj^u), 
let II be the second fundamental form of S in {Q,g{t)) with respect to 
u, let X be the vector field on E that is dual to the 1-form h{i>, •) |r(s) on 
(S, 7) and let div^X be the divergence of X on (E, 7). For convenience, 
we often omit writing the volume form in an integral. As in [16, (34)], 
we have 

(2.3) 

2F'(0) = j 2H'{0)N 

= J N {[d{trgh) - divgh]n - div^X - (II, h)^) 

= / N[d{tj:gh) — divgh]n — / Ndiv^X (because /i|ts = 0) 
Jt. Jt. 

= N [Ag{trgh) - div<;(divg/i)] - / tr^/iAX + / tYgh{dN)n 
Jn Jn Jt, 

- [ {dN, divgh)g - [ NdiY^X 
Jn is 

= - / N{h,Ric{g))g- [ tTghAN+ [ ilgh{dN)^ 
Jn Jn Jt, 

+ [ {VlN,h)g- I h{v,VN) - [ Ndiv.,X (using dH and fl23|) ) 
Jn Jt Jt 

= [ {h, -NRic{g) - {AgN)g + VjX)^ 
Jn 

+ [ iigh{dN)n - [ h{v, VN) - [ NdiY^X, 
Jt Jt Jt 



where we have used the facts 



(2.4) / {dN,diYgh)g = - [ {VlN,h)g+ ^ h{u,VN) 

Jn Jn Jt 
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and 
(2.5) 

DRg{h) = J^R{t)\t = = -Agitigh) + diVgidiYgh) - ( /l , RiC ( ) ) , = 0. 

Here R{t) is the scalar curvature of g{t). Let V^iV denote the gradient 

of N on (S, 0"). Integrating by parts on S, we have 

(2.6) 

f Ndiv^X = - I {V^N,X)^ = - I h{u,VN)+ I h{v,v){dN)n. 

t/S t/S t/S t/S 

On the other hand, iigh = h{u,u) at S. Hence, F'(0) = by (Q, 
([23D, and O- 

To prove the converse, suppose g is a critical point of F^{-). Let 
{g{t)} be any smooth path in passing g = g{0). Let h = g'{0) and 
F{t) = F^{g(t)). As before, we have 



2F'(0) = f 2H'{0)^ 

(2.7) 



(f)[d{tTgh) — div gh]n — / 0div^X. 
s is 

Since the first Dirichlet eigenvalue of {n — l)Ag + K is positive and (j) 
is not identically zero, there exists a unique smooth function N = 
which is not identically zero on Q such that 

...X / in-l)AgN + KN = 0, on n 

^^■^^ \ N = (f), atE. 

With such an N given, we have 

(l)[d{tTgh) — divgh]n — / 0div^X 

is 

N[Ag{tTgh) -divgidivgh)]- / tighAN + / tTgh{dN)n 

Jn Jt. 

- [ {dN, diYgh)g - [ Xdiv^X 
Jn Jt, 

= [ N{-l){h,Ric{g))g- [ tighAN + [ {VlN,h)g, 
Jn Jn Jn 

where we used the fact DRg{h) = (the boundary terms canceled as 
before and we have not used fl2.8p yet). 

Now let h be any smooth symmetric (0,2) tensor with compact sup- 
port in Q. For each t sufficiently small, we can find a smooth positive 



(2.9) 



Geometric problems related to Brown- York and Liu-Yau quasilocal mass 7 

function u{t) on Q such that 'u(t) = 1 at S and 

git) = u{t)^^{g + th) eM"^. 

Moreover, u(t) is differentiable at t = and u{0) = 1 on fl. See the 
proof of [TBI, Theorem 5] for details on the existence of such a u{t). Now 
^'(0) = ;^m'(0)c/ + h. Hence, by ([22D and ([23]) we have 

2F'(0) = / {^u'{0)g + k -NRicig) - {A,N)g + V^iV), 

(2.10) = / {h, -NRicig) - i\N)g + V^N), 

Jn 

+ I -^u'{0) [-KN - n{AgN) + A,iV] . 

By (12.81) . the second integral in the above equation is zero. Hence, we 
have 

(2.11) 2F'(0) = / {h, -NRicig) " i\N)g + VjiV)^. 

Jn 

Since h can be arbitrary, we conclude that g and satisfy (12.21) . □ 

Remark 2.1. U K < 0, then the condition that the first Dirichlet eigen- 
value of {n — l)Ag + i^' is positive holds automatically for g G Ai^ . 

As a direct corollary of Theorem 12.11 we have 

Corollary 2.1. With the notations given as in Theorem \2.1[ suppose 
K = and 0=1. Then g G is a critical point of H da if and 
only if g is a Ricci flat metric. In particular, if n = 3, then g G is 
a critical point of jj, H da if and only if g is a flat metric. 

If does not change sign on the boundary, we further have: 

Corollary 2.2. With the notations given as in Theorem \2.1\ suppose 
(p > or (f) < on T,. Suppose g G Aii^ is a static metric. If K > 0, 
we also assume that the first Dirichlet eigenvalue of [n — l)Ag + K 
is positive. Let g{t) he a smooth family of smooth metrics on Vl with 
(7(0) = g such that 

(i) the scalar curvature of g{t) is at least K. 

(ii) g{t) induces 7 on S. 

Then 

^FMt))\t=o = 0. 
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Proof. We prove the case that > on S. The case that < on S 
is similar. 

By the assumption of g, for t small, we can find smooth positive 

4 

functions u{t) on fl with u(t) = 1 on E such that g(t) = U"-'^ (t)g{t) G 
, u{t) is differentiable at t = and u(0) = 1 (see the proof of 

Proposition 1 in [16]). The mean curvature H{t) of E in {VL.,g{t)) is 
given by 

where H{t) and Vt are the mean curvature and the unit outward normal 
of S in {VL,g{t)). Note that u satisfies: 



(2.13) 



■ 4(re-l) 



n+2 



u = 1, on S, 



where K{t) is the scalar curvature of g{t). Since K{t) > K, by the 
maximum principle, we have 

> 

Hence, H{t) > H{t) and consequently F^{g{t)) > F^{g{t)) by the as- 
sumption > on S. By Theorem 12.11 we have 

^F^(^(t))|i=o = 0. 
Since 5^(0) = (7(0), we conclude 



|F,(^(t))|,=o = 0. 



□ 



Here are some examples provided by Theorem 12. It 
Example 1: Let f2 be a bounded domain in with smooth bound- 
ary E. Then the standard Euclidean metric is a critical point of F(f,{-) 
with = 1. If S is strictly convex, then this follows also from the result 
in pj. 

Example 2: Let be a bounded domain in with smooth bound- 
ary S. Then the standard Hyperbolic metric is a critical point of F^{-) 
with = coshr, where r is the distance function on H" from a fixed 
point. If S is strictly convex and n = 3, then this follows also from the 
result in [20j. 

Example 3: Let be a domain in §" with smooth boundary E such 
that the volume of f2 is less than 2ti. Then the standard metric on §" is 
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a critical point of F^{-) with = cosr, where r is the distance function 
on §" from a fixed point. 

Example 4: Let Q he a bounded domain with smooth boundary in 
the Schwarzschild manifold \ {0} with metric 

= + ^ j 

with m > and r = Then on is a critical point for F^{-) with 
0=(l-f)/(l + f). 

Example 5: Complete conformally flat Riemannian manifolds with 
static metrics have been classified by Kobayashi in [T^l Theorem 3.1]. 
In addition to the manifolds in the previous examples, there are other 
kind of static metrics with N being explicitly constructed. Domains in 
these manifolds will be critical points of where is the restriction 
of to the boundary. See [12] for more details. 



3. Derivative of the Brown- York mass 

In this section, we give a derivative formula that describes how the 
Brown- York mass of a surface changes if the surface is evolving in an 
ambient Riemannian manifold. Our main result is: 

Theorem 3.1. Let be the 2-dimensional sphere. Let {M,g) be a 
3-dimensional Riemannian manifold. Let I be an open interval in M}. 
Suppose 

F : §2 X / — > M 
is a smooth map such that, for t E I , 

(i) Sj = F(S^,t) is an embedded surface in M and Sj has positive 
Gaussian curvature. 

(ii) The velocity vector ^ is always perpendicular to S^, i.e 

dF 
'dt 



where u is a given unit vector field normal to and r] = (^, z^) 
denotes the speed ofEt with respect to v. 
Consider m^^iT^t) , the Brown- York mass ofJ^t in {M,g), defined by 

(3.1) nT3,,(S,) = ^ / {H,-H)dat, 

where Hq is the mean curvature ofJ^t with respect to the outward normal 
when isometrically embedded in M'^, H is the mean curvature ofEt with 
respect to v in (M, g\ and dot is the volume form of the induced metric 
on St. 
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We have 

(3.2) ^mBY(St) = / {1^0 -A\'- \H, - H\' + R)r] da^, 

J St 

where Aq is the second fundamental form of with respect to the out- 
ward normal when isometrically embedded in M.^, A is the second fun- 
damental form of Tit with respect to v in {M,g), and R is the scalar 
curvature of (M, g) . 

Our proof of Theorem 13.11 makes use of a recent formula of Wang 
and Yau (Proposition 6.1 in |23j): 

Proposition 3.1. Let S be an orientable closed embedded hypersurface 
in R"^^. Let {Ilt}\t\<5 be a smooth variation ofT, in R"^^. Then 

(3.3) ^ (^^ Ho dat^ |i=o = ^ ^ (^otrs/i - (^o, h)) da, 

where Hq and Aq are the mean curvature and the second fundamental 
form ofE with respect to the outward normal in W^'^'^ , h is the variation 
of the induced metric a on E, tij^h = {a, h) denotes the trace of h with 
respect to a , and dot, da denote the volume form on Tt, S. 

In order to apply Proposition 13.11 we will need to show that, on a 
closed convex surface E in M'^, an abstract metric variation on E indeed 
arises from a surface variation {E^} of E in M^. Precisely, we have: 

Proposition 3.2. Given an integer k > 6 and a number < a < 
1, let {<y{t)}\t\<i be a path of C^''^ metrics on such that {a{t)} is 
differentiate at t = in the space of 0^'°" metrics. Suppose (j(0) has 
positive Gaussian curvature. Then there exists a small number 5 > 
and a path ofC^'"" embeddings {f{t)}\t\<5 ofS"^ mR^ such that f{t) is an 
isometric embedding of {S'^,a{t)) for \t\ < 6 and {f(t)} is differentiable 
at t = in the space of C^'" embeddings. 

The proposition above follows from the arguments by Nirenberg in 
|17j . For completeness, we include its proof here. 

Proof. Given {o-(t)}|(|<i}, a path of C^'" metrics on S^, let h = a'{0). 
Then his a C^'" symmetric (0,2) tensor. Since a{0) has positive Gauss- 
ian curvature, by the result in jT^, there exists a C'^'" isometric em- 
bedding of (S^,cr(0)) in R^, which we denote by X. Given such an X, 
let y : ^ R'^ be a C^'° solution to the linear equation 



(3.4) 



2dX -dY = h, 
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where " • " denotes the Euchdean dot product in and (13 .4^ is under- 
stood as 

dX{ei) ■ dY{e2) + dX{e2) ■ dY{ei) = h{ei, es) 

for any tangent vectors ei, 62 to The existence of such a F is 
provided by Theorem 2' in [17] . Let da"^ = h and let 0, pi, p2 be given 
as in (6.5), (6.6) in [17], then satisfies (6.15) in [17J. Using the fact 
that X is in C^'" and da"^ is in C^'", we check that the coefficients 
of (6.15) in [17J (when written in a non-divergence form) is in C^~^'°'. 
Thus, it follows from (6.15) in [17] that G C'^~^'°', from which we 
conclude Y e C"=-^'" by (6.11)-(6.13) in [IT]. 

Now consider the C^~^'°' path of embeddings {G{t)}\t\<:to, where 

(3.5) G{t)=X + tY 

and to is chosen so that G{t) is an embedding. Let Qe be the Euclidean 
metric on M.^. The pull back metric r(t) = G{t)*{ge) which is in C''~'^'°' 
satisfies 

(3.6) r(0) = a(0), r'(0) = (7'(0), 
which implies 

(3.7) \\T{t)-a{t)\\c2..=0{t'). 

Apply Lemma 15.31 in the Appendix to cr° = cr(0) = t(0), for each 
t sufficiently small, we can find a C^'" isometric embedding X{t) of 
(§^a(t)) in such that 

(3.8) \\Git) - Xit)\y.. < G\\T{t) - a{t)\y.. = 0(1'). 

(By Lemma 1' in [T7], X{t) indeed lies in C'^'".) It follows from (13.81) 
that {X(t)}, when viewed as a path in the space of C^'° embeddings, 
is differentiable at t = 0. Proposition 13.21 is therefore proved. □ 

Proposition 13.11 and Proposition 13.21 together imply: 

Proposition 3.3. Given an integer k > 6 and a number < a < 1, 
suppose {o"(t)}|t|<i is a differentiable path in the space of G'^'°' metrics 
on Suppose a{t) has positive Gaussian curvature for each t. Let 
Hq be the mean curvature of the isometric embedding of (§^,cT(t)) in 
with respect to the outward normal. Let dat be the volume form of 
cr{t). Then 
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is a differentiable function oft, and 

(3.9) ^ Ho da}j = ^ jjHoa{t) - Ao, h)) dat, 

where Aq is the second fundamental form of the isometric embedding of 
(§^,cr(t)) in M.^ with respect to the outward normal, h = (j'{t), "(■,■)" 
denotes the metric product with respect to a{t) on the space of symmet- 
ric (0, 2) tensors. 



Proof. Take any to £ !)■ By Proposition 13. 2[ there exists a small 
positive number S (depending on to) and a path of C^'" embeddings 
{f(f)}\t-to\<s of §^ in R^, such that f{t) is an isometric embedding of 
(§^,cr(t)) and {f(t)} is differentiable at t = to in the space of C^'" 
embeddings. 

Let St = /(t)(§^), let Holt) be the mean curvature of Ht with respect 
to the outward normal in M^, by definition we have 

(3.10) / Ho dcxt = / Ho{t) dat, V |t-to| < 6. 

Apply the fact that {fit)} is differentiable at t = to in the space of C^'" 
embeddings and note that Ho only involves derivatives of /(t) up to the 
second order, we conclude that J^.^ Ho{t) dat is differentiable at to. By 
fl3.10p . Ho dat is differentiable at to as well. This shows Jga Ho dat is 
a differentiable function of t. Equation (13.91) then follows directly from 
fIXTU]) and Proposition O □ 

We are now ready to prove Theorem 13.11 using Proposition 13.31 

Proof of Theorem \3.1[ By Proposition 13. 3^ the function xnj^^(T,t) is a 
differentiable function of t. We have 

(3-11) ^n^Bv(St) = ^^f/ Ho dat]- ^4- ( [ H dat 



dt ""^^ ' 871 dt VJe, 7 8ndt vje* 

Let a = a{t) be the induced metric on S^. By (13.91) in Proposition 13. 3^ 
we have 

Now, applying the fact that {S^} evolves in {M,g) according to 

OF 

(3.13) ^ = 

we have 

(3.14) % = ^'^'^^ 
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and 

dH 

(3.15) — = -Ar; - (|Ap + Ric(z/, z/))r/, 

where Ric(z/, v) is the Ricci curvature of {M,g) along u. Thus, 

jj[ Ho daA = i / {Hoa{t) - Ao,2r]A) dat 



St 



/ HqHt] - {Ao, A)r] dat 

J St 



^ H dat^ = J^^ + H^r] dat 

-(|A|2 + Ric(i/, iy))7] + H^r] dat 



(3.16) 



and 



(3.17) 



Hence, it follows from (13TTD . (KW\ and (IXTTj) that 
(3.18) 

-^m,,(S,) = ^ / [HoH~{Ao,A) + {\A\' + Ric{u,u))~H']vdat. 
at 8tt 

Apply the Gauss equation to in (M, ^f) and to the isometric embed- 
ding of St in respectively, we have 

(3.19) 2K = R-2mc{u,u) + -\A\'^, 
and 

(3.20) 2K = {Hof - \Ao\\ 

where K is the Gaussian curvature of S^. Hence, fl3.18l) - fl3.20l) imply 
that 

(3.21) lm,^(St) = ^^ [\Ao-A\'-{Ho-Hy + R]r]dat. 

Therefore, (13. 2p is proved. □ 

Next, we want to discuss some applications of Theorem 13. II The first 
two applications below put the monotonicity property of the Brown- 
York mass in the construction in [19] into a more general context. 



Corollary 3.1. Let (M,g), I, F, {S^}, rj, A, Ao, H and Ho be given 
as in Theorem \3.1\ with r] > 0. Suppose at each point x G S^, t & I, 
Ao — A is either positive semi-definite or negative semi-definite, and 
R < 0, then xn^^CEt) is nonincreasing in t. If in addition, A = aAo 
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for some number a depending on x & S^, then mj^^{T,t) is constant in 
I if and only if x /, F*{g)) is a domain in M.^. 

Proof. Let Ai,A2 be the eigenvalues of Aq — A. Suppose Aq — A is 
either positive semi-definite or negative semi-definite, then A1A2 > 
and hence \Ao - - \Ho - H\'^ = -2A1A2 < 0. Since i? < 0, by 
Theorem 13.11 we have: 

|m„(E.)<0 

because r/ > 0. This proves the first assertion. 

Suppose X /, F*{g)) is a domain in M^, then by definition we have 
m.^^{T.t) = 0, Vt. Hence, 

|n,„(S,) = 0. 

Conversely, suppose A = aAQ and 

|m„(E,) = 0. 

Then R = and A = Aq. In particular, H = Hq. For any (ti,t2) C /, 
let n = §^ X (^1,^2) with the pull back metric F*{g). Let D be the 
interior of = F{EP' x {ti}) when it is isometrically embedded in 
and E be the exterior of = F(§^ x {^2}) when it is isometrically 
embedded in M^. By gluing Q with D along x {ti}, which is identified 
with through F, and gluing Q with E along x {t2}, which is 
identified with E^^ through F, we have an asymptotically fiat and scalar 
fiat manifold with corners and with zero mass, and it must be fiat by 
[T5] [19j . Hence, Q is fiat. Since it is simply connected, Q can be 
isometrically embedded in M^. 

□ 

Corollary 3.2. Let {M,g), I, F, {EJ, rj, A, Aq, H and Hq be given 
as in Theorem \3.1[ Let g^ be the Euclidean metric on R^. Suppose 
there exists another smooth map 

F° : §2 X / — . R3 

such that 

(i) S° = F°(S^,t) is an embedded closed convex surface in and 

(F^Tige) = F:{g), 
where FO(-) = F^{-,t) and Ft{-) = F{-,t). 
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(ii) The velocity vector is always perpendicular to i.e 

dF' 
^ = ^'^' 

where is the outward unit normal to S° in and rf denotes 
the speed ofE^ with respect to . 

Suppose 7]^ > 0, f] > and {M,g) has zero scalar curvature, then 
the Brown- York mass m^^CEt) is monotonically non-increasing, and 
mgY(St) is a constant if and only if (S^ x /, F*{g)) is a domain in M^. 

Proof. Since rj^ > and r/ > 0, we can write {F^)*{ge) and F*{g) as 

(3.22) F*{g,) = (r^^dt^ + g^ and F*{g) = r,Mt'' + g^, 

where gt denotes the same induced metric on both and S^. Now it 
follows from (13:221) that 

(3.23) A = — Aq. 

V 

Since Aq is positive definite, the results follow from Corollary 13. 1[ □ 

Remark 3.1. We note that 

(i) Quasi-spherical metrics constructed in [19] satisfy all the as- 
sumptions of Corollary 13. 2[ 

(ii) In case 77° = 1, one recovers the monotonicity formula in [19]. 

By applying the co-area formula directly to (13. 2p . we also obtain 

Corollary 3.3. Let {M,g), F, {S*}, rj. A, Aq, H and Hq be given as 
in Theorem \3.1[ Suppose rj > 0. For any ti < t2, let ^[1^,12] be the 
region bounded by Sj^ and Et^ . Then 

(3.24) m3,(SiJ -m3,(SiJ = t^(/ R dV + [ <^ dV 

where R is the scalar curvature of {M,g), dV is the volume form of g 
on M , and $ is the function on VL[ti,t2\! depending on {S^}, defined by 

(3.25) $(x) = \Ao - - (i/o - Hf, X G S^. 

The function $(x) defined above clearly depends on the foliation 
{E^} connecting Ej^ to E^j. However, it is interesting to note that the 
integral /^^^ ^ ^ $ dV turns out to be {Ej} independent by (I3.24p . 

We can apply formula (I3.24p to small geodesic balls in a general 3- 
manifold and to asymptotically fiat regions in an asymptotically fiat 
3-manifold. 
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Corollary 3.4. Let {M,g) be a 3-dimensional Riemannian manifold. 
Let p E M and Bs{p) he a geodesic hall centered at p with geodesic 
radius 6. Suppose 6 is small enough such that 

(1) 6 < ip{M), where ip{M) is the injectivity radius of {M,g) at p. 

(2) For any < r < S, the geodesic sphere Sr{p), centered at p with 
geodesic radius r, has positive Gaussian curvature. 

Then the Brow- York mass of Ss{p) can he written as 

(3.26) m^^iSsip)) = T^( [ RdV+ [ <^ dv) , 

J-OTT \Jbs{p) JBs(p)\{p} J 

where R is the scalar curvature of M , dV is the volume form on M , 
and $ is the function on Bs{p) \ {p}, defined hy 

(3.27) ^{x) = \Ao - - {Ho - Hf, x G 5,. 

Here A, H are the second fundamental form, the mean curvature of 
in M with respect to the outward normal; and Aq, Hq are the second 
fundamental form, the mean curvature of the isometric emhedding of 
Sr in with respect to the outward normal. 

Proof. Let (r, tu) be the geodesic polar coordinate of x G Bs{p) \ {p}, 
where r denotes the distance from x to p. Since ^ J. Sr, we can choose 
the foliation {E^} in Corollary 13. II to be {Sr} with t = r. By (13.241) . we 
have 

(3.28) m^ASsip)) - m^^Srip)) = / (i? + $ ) dV. 
By [8], we have 

(3.29) ]imm,ASr{p))=0. 

r— >0+ 

Hence, ^TM follows from (IX^ and (IX^ . □ 

Next, we express the ADM mass |1] as the sum of the Brown- York 
mass of a coordinate sphere and an integral involving the scalar curva- 
ture and the function $(2;). 

Corollary 3.5. Let {M,g) he an asymptotically flat 3 -manifold with a 
given end. Let {x* \ i = 1,2,3} he a coordinate system at 00 defining 
the asymptotic structure of {M,g). Let Sr = {x E M \ \x\ = r} he 
the coordinate sphere, where \x\ denotes the coordinate length. Suppose 
ro ^ 1 zs a constant such that Sr has positive Gaussian curvature for 
each r > vq. Then 

(3.30) m,,, = m^^Sr,) + ^ [ ^ + ^ f ^ dV, 
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where vti^dm is the ADM mass of {M,g), R is the scalar curvature of 
{M,g), is the bounded open set in M enclosed by Sr^, and $ is the 
function on M \ D^q defined by 

(3.31) ^{x) = \Ao - - {Ho - Hf, X G Sr. 

Here A, H are the second fundamental form, the mean curvature of Sr 
inM; andAo, Hq are the second fundamental form, the mean curvature 
of Sr when isometrically embedded in . 

Proof. {Sr}r>ro consists of level sets of the function r on M\DrQ, hence 
can be reparameterized to evolve in a way that its velocity vector is 
perpendicular to the surface at each time. To be precise, we can define 
the vector field X = on M\DrQ and let 7p(t) be the integral curve 
of X starting at p G Sr^. For any t > 0, let = {7p(t) \ p ^ Sr^}, then 
= Sro+t- For any T > 0, apply f l3.24p to {T,t}o<t<T, we have 

(3.32) m,,{Sr,+T) - m3,(5,J = t^(/ R dV + f ^ dV 

where ^[o,t] is the region in M bounded by Sq = and = Sr^+T. 
Letting T — > +cxd, by [8J we have 

(3.33) \im m^^{ST)=xn^^^. 

1 — * + CxD 

Hence, ([S3DD follows from i^M) and (IX^ . □ 



4. Liu-Yau mass of spacelike two-surfaces in 



p3,l 



Let S be a closed, connected, 2-dimensional spacelike surface in a 
spacetime N . Suppose S has positive Gaussian curvature and has 
spacelike mean curvature vector H in A^. Let Hq be the mean cur- 
vature of S with respect to the outward unit normal when it is isomet- 
rically embedded in 'E?. The Liu-Yau mass of S is then defined as (see 

mm)-- 

m,,(S) = ^ / {Ho-\H\)da, 

where is Lorentzian norm of if in iV and da is the volume form of 
the induced metric on S. 

In [13], the following positivity result was proved: Let Q be a compact, 
spacelike hypersurface in a spacetime N satisfying the dominant energy 
conditions. Suppose the boundary dfl has finitely many components 
Sj, 1 < i < I, each of which has positive Gaussian curvature and has 
spacelike mean curvature vector in N. Then mj^^{T,i) > for all i; 
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moreover if m^^{T,i) = for some i, then dfl is connected and N is a 
fiat spacetime along Q. 

We remark that in their proof of the above result, it is assumed 
imphcitly that the mean curvature of dfl in Q with respect to the 
outward unit normal is positive. See the statement [22l Theorem 1.1]. 
The condition is necessary as can be seen by the following example in 
the time symmetric case: 

Let Qe be the Euclidean metric on and let m > be a constant. 
Consider the Schwarzschild metric (with negative mass) 

defined on {0 < \x\ < y}. Given any < ri < r2 < y, consider the 
domain 

Q = {ri < \x\ < . 

For any constant r, the mean curvature H of the sphere Sr = {\x\ = r} 
with respect to the unit normal in the direction of d/dr is 

1 /2 4 m 

H=- — TT - + 



\r 1 - ^2r2 

The mean curvature of Sr when it is embedded in is 

1 2 



Suppose r < Y, then H < and 



\H\ — Ho = — —r > 0. 

Hence, mLY(5'r.J < and m^^{Sr^) < where dQ = Sr^ U Sr^. 

In [18], O Murchadha, Szabados and Tod gave some examples of 
a spacelike 2-surface, lying on the light cone of the Minkowski space 
M^'\ whose Liu-Yau mass is strictly positive. Motivated by their result, 
we want to understand the Liu-Yau mass of more general spacelike 2- 
surfaces in M^'^. In the sequel, we always regard as the t = slice 
in R^'^. We have the following: 

Theorem 4.1. Let S be a closed, connected, smooth, spacelike 2- surface 



in 



1)3,1 



Suppose S spans a compact spacelike hypersurface in M.^'^. If 
S has positive Gaussian curvature and has spacelike mean curvature 
vector, then m^-yCE) > 0; moreover m.j-^y{T,) = if and only ifH lies on 
a hyperplane in 'E?'^ . 
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In order to prove this theorem, we need the following result which 
can be proved by the method of Bartnik and Simon [1] and by an idea 
from Bartnik [2J. In fact, it is just a special case of the results by 
Bartnik [3j. 

Lemma 4.1. Let H he a closed, connected, smooth, spacelike 2-surface 
in M.^'^. Suppose S spans a compact spacelike hypersurface in M^'^. 
Then S spans a compact, smoothly immersed, maximal spacelike hyper- 
surface in M'^'^. 

Proof. Let M be a compact spacelike hypersurface in M^'^ spanned by 
S. By extending M a bit, we may assume that there exists a spacelike 
hypersurface M in M^'^ such that M C M. Since M is spacelike, M 
is locally a graph over an open set in M^. Hence, the projection map 
TT : M M^, given by 7r{x,t) local diffeomorphism. Now 

consider the map 

(4.1) F:MxR^ — >R^'\ 

given by F{p,s) = {x,s) for any p = {x,t) G M, then F is a local 
diffeomorphism as well. Let N = M x M} equipped with the pull back 
metric. Let v be the time function on M in M^'^, i.e. v{x,t) = t. Since 
w is a smooth function on M, we can consider its graph in A^. Let S 
and G be the graph of v over S and M in iV respectively. Then G is a 
compact, spacelike hypersurface in whose boundary is S. Moreover, 
: G ^ M C M^'^ and : S ^ S C M^'^ are both isometries. 
Now one can carry over the arguments in section 3 in [4J to prove 
that there is a smooth solution (defined on M) to the maximal surface 
equation in N such that, if G is its graph in A^, then dG = S. For 
example. Lemma 3.3 in [4j can be rephrased as: For 6 > 0, let 

V = {^e C°'i(M)| < (1 - 9)} 

and 

J-" = iu E C'^(M) I \Du\ < 1 with maximal graph 

(4.2) ^ . 

and u = (j) onTj for some (f) G V}. 

Then there exists ro > and > such that for all m G and for 
all p,q E M with d{p, S), d(q, E) < |ro(say) and d{p, q) = Tq we have: 
\u{p) - u{q)\ < (1 - Oi)ro. 

One then readily checks that F{G) is a compact, smoothly immersed, 
maximal hypersurface in M^'^ spanned by E = -F(S). □ 
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To prove Theorem I4.H we also need a technical lemma concerning 
the boundary mean curvature of a compact spacelike hypersurface in 
M^'^, whose boundary has spacelike mean curvature vector. 

Lemma 4.2. Let M he a compact S-manifold with boundary DM . Let 
F : M M.^'^ be a smooth, maximal spacelike immersion such that 
F\gM '■ dM —>■ F{dM) C M.^'^ has spacelike mean curvature vector. Let 
g be the pull back metric on M and k be the mean curvature of dM 
in (M, g) with respect to the outward unit normal. Then k must be 
nonnegative at some point on dM. 

Proof. Suppose k < everywhere on dM. Since F{M) is a compact 
subset in M^'^, without loss of generality, we may assume that F{M) C 
{xi < 0} and F(M)n{xi = 0} 7^ 0. Let Xq = F{q) e F{M)n{xi = 0} 
for some q G M. If q is an interior point of M, then there exists an 
open neighborhood \^ of g in the interior of M such that the tangent 
space of F{V) at Xq is {xi = 0}. This is impossible, because F{V) 
needs to be spacelike. Therefore, q G dM. Using the fact that F is a 
spacelike immersion again, we know there exists an open neighborhood 
U of q in M such that F{U) is a spacelike graph of some function / 
over D for some open set D C n {xi < 0}. Let B = F{U f] dM) 
and let B be the part of dD such that B is the graph of / over B. We 
note that Xq G -B. Without loss of generality, we may assume that Xq 
is the origin. 

To proceed, we let T = ^ and define the following notations: 

n: the future time like unit normal to F{U) in M^'^; 

z/: the unit outward normal to B in F{U); 

v: the unit outward normal to i? in D. 
We parallel translate v and all the tangent vectors of S, B along the 
T direction. Also, we consider / as a function on D x (—00, 00) so that 
/ is independent of t. 

Now V is normal to B, so = uu + vn for some numbers u,v 
satisfying — = 1. At Xq G -B, we have u = Suppose 

a(s) = X2(s), X3(s), t(s)) is a curve in F{U) such that q;(0) = Xq 

and a;'(0) = v. Then, for t < small, a{t) G F{U) and so Xi{t) < 0. 
Since a;i(0) = 0, we have x'lifS) > 0, hence u = {v.v) > 0. Since 
V? = 1 + f ^, we have u > \v\ at Xq. 

Let H be the mean curvature vector of B in M^'^. Let p = pij be the 
second fundamental form of F{U) in M^'^ with respect to n. Then 



(4.3) 



— * 

H = —kv + (trgp)n. 
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where ti^p denotes the trace of p restricted to B. Hence, 

(4.4) - {H,9) = uk + v{tTgp). 

At Xq, we have shown u > \v\. On the other hand, we know > |tr^p| 
(because H is spacehke) and k < (by the assumption), therefore we 

— * 

have —{H, u) < at Xq. Recall that 

2 

(4.5) (#,z>) = (^Ve,e,,i/), 

i=l 

where {ei, 62} is an orthonormal frame in B and V is the covariant 
derivative in M^'^. Hence there exists a unit vector e & B such that 

(4.6) -(Vee,z>)<0. 

Suppose e is the tangent of a curve 7(5) C -B at s = 0. Let 7(3) C B 
be the projection of 7(5) in R^. Then 

(4.7) 7'(5) = lis) + ^J\l{s))T. 
Hence, 

-(Vy(s)7'(s), z>) = -(Vy(,)7'(s), z>) 

= -(Vy(s)7 [s),v), 

where we have used the facts that T is parallel, T _L z/ and i'{s) is 
parallel translated along T. Thus, it follows from (14.61) . (14. 8 p and the 

fact e = 7'(0) that 

(4.9) _(Vy(o)7'(0),z>) <0. 

But this is impossible because 7(5) C B C {xi < 0}nM^ and z> = at 
7(0). Therefore, we have proved that k can not be negative everywhere 
on dM. □ 

Proof of Theorem \4.1\ By Lemma I^TTl we know that S indeed bounds a 
compact, smoothly immersed, maximal spacelike hypersurface in M^'^. 
Precisely, this means that there exists a compact 3-manifold M with 
boundary dM and a smooth, maximal spacelike immersion F : M ^ 
M.^'^ such that F : dM — > E is a diffeomorphism. 

Let g = gij be the pull back metric on M. Let p = pij be the second 
fundamental form of the immersion F : M ^ Let R be the scalar 
curvature of {M,g). Since F is a maximal immersion, it follows from 
the constraint equations (or simply the Gauss equation) that 

(4.10) R=\p\'^>0, 
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where "| ■ |" is taken with respect to g. On the other hand, let k be 
the mean curvature of dM in (M, g) with respect to the outward unit 
normal and let H be the mean curvature vector of S = F{dM) in M^'^, 
it is known that 

(4.11) \H\' = k'-itr,pY, 

where ti^p is the trace of p restricted to S. Since H is spacelike, (14.111) 
implies that either > or /c < on dM because dM is connected. 
By Lemma [4.21 we have k > on dM. 

Now let kQ be the mean curvature of E with respect to the unit 
outward normal when it is isometrically embedded in M.^. It follows 
from fliATj) that 

(4.12) [ {ko - \H\) da> [ {ko - k) da. 
On the other hand, by the result of pS], we have 

(4.13) / {kQ -k) dcr>0 



and equality holds if and only if {M,g) is a domain in R^. Thus, 
we conclude from (14.121) and (I4.13P that mLY(S) > 0. Moreover, if 
mLY(S) = 0, then {M,g) must be flat, hence R = and consequently 
p = 0. Therefore, F{M) and hence S lie on a hyperplane in M^'^. 
Conversely, if S lies on a hyperplane in M^'^, then obviously mLY(S) = 
0. □ 

In the sequel, we want to show that the examples given in [TS] satisfy 
the assumption in Theorem 14. 1[ To do that, we need the following 
definition: 

Definition 4.1. Two points p and g in a Lorentzian manifold are 
said to be causally related if p and q can be joined by a timelike or null 
path. A set in is called acausal if no two points in S are causally 
related. 



We claim that all surfaces in the examples in [TH] are acausal. Sup- 
pose this claim is true, then by Theorem 3 in |S](P.4765), we know that 
those surfaces span spacelike hypersurfaces in M'^'^, hence satisfying the 
assumption in Theorem 14. 1[ 

To verify the claim, let S be an example given in [18], i.e. in terms 
of the usual spherical coordinates (t, r, 6, 0) in M^'^, E is determined by 
the equation 

(4.14) t = r = F{e,(f)), 
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where F = F{9, 0) is a smooth positive function of {9, 0) G S^. Suppose 
S is not acausal, then there exists two distinct points p, g in S and a 
path 7(r) in E such that 7(0) = p, 7(1) = q, and 

(4.15) + (^)2 + (^)2 < (^)2^ VrG [0,1], 

here we denote 7(r) = (a;(r), y(r), 2;(r), t(r)) and " ' " denotes the 
derivative with respect to r. Since 7 7^ 0, without loss of generahty, we 
may assume t > 0. Let r = 1^x^ + 1/^ + 2;^, (14.151) imphes that 

(4.16) |r| < i 

Note that r(0) = t(0) and r(l) = t(l), we see that 

(4.17) \r\=i, 

for all T G [0, 1]. By the equality case in the Cauchy- Schwartz inequal- 
ity, we must have 

(4.18) X = k{T)x, y = k{T)y, z = k{T)z 

for some function k = k{T) and for all r G [0, 1]. Clearly, this implies 
that p and q lie on a line which passes through the origin, or equiva- 
lently, p = aq for some positive number a. On the other hand, using 
the Cartesian coordinates, we may write p as 

(F(^i, 0i), F(^i, 0i) sin 01 cos 0i, F(^i, 0i) sin ^1 sin 0i, F(^i, 0i) cos ^i) 
and write q as 

(F(^2, 02), -^(6*2, 02) sin 6I2 COS02, -F(6l2, 02) sin 6I2 sin 02,-^^(^2,02) COS02) 

for some (^j, 0j) G S^, i = 1, 2. The fact p = aq, for some a > 0, then 
implies p = q, which is contradiction. Therefore, S is acausal. 



5. Appendix 

In this appendix, we give some Lemmas which are needed to com- 
plete the proof of Proposition 13.21 We will follow closely Nirenberg's 
argument in [17]. First, we introduce some notations: given an integer 
k > 2 and a positive number a < 1, let 

gk,a _ -j-j^g space of C'^'" embeddings of S'^ into 
^k,a _ -j-j^g space of C'^'" M'^— valued vector functions on S'^ 
^k,a _ ^YiQ space of C'^'" symmetric (0, 2) tensors on S*^ 
space of Riemannian metrics on S"^. 

On page 353 in [T7], Nirenberg proved 
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Lemma 5.1. Let a G be a metric with positive Gaussian curva- 

ture. Let X G S^'"' be an isometric embedding o/(§^,cr) in M?. There 
exists two positive numbers e and C , depending only on a , such that if 
r G A^^'" satisfying 

I W ~ '''I Ic^.a < 

then there is an isometric embedding Y G of r) in such that 

\\X — Y\ \ c2,a ^ C*| l^"" ~ t| \ c^,a . 

In what follows, we want to show that the constants e and C in the 
above Lemma can be chosen to be independent on a, provided a is 
sufficiently close to some G A^^'" (see Lemma [5.3p . First, we prove 
the following: 

Lemma 5.2. Let cr° G A^^'" be a metric with positive Gaussian cur- 
vature. There exists positive numbers 6 and K, depending only on a^, 
such that if (T E A^^'" satisfying 

then for any 7 G 5^'" and any Z G A*^'", there exists a solution Y G 
A"^'" to the linear equation 

(5.1) 2dX'' ■ dY = -f - (dZ)^. 

Here X^ G is any given isometric embedding o/(§^,cr). Moreover, 
for every Z (with 7 fixed), a particular solution Y denoted by ^{Z) may 
be chosen so that 

(5.2) \mZ)\\c2.. < k {\Mc2,. + \\Z\\l,,^) , 
and for any Z, Z^ G 

(5.3) ||$(Z) - <l>(Zi)||c2,^ < k\\Z + Zi\\c2.c, ■ \\Z - Zi\\c2,c. 

Proof. We proceed exactly as in |T^. For any a G A^^'", let X"" be a 
given isometric embedding of (§^, a) in M^. Let X3 be the unit inner 
normal to the surface X°'(§^). Let {u,v} be a local coordinate chart 
on S^. Let 0, pi, p2 be defined as in (6.5), (6.6) in [17]. Then 0, pi, 
P2 satisfy the system of equations (6.11)-(6.13) in [T7] with ci, C2, A 
defined on page 356-357 in [17j. By section 6.3 in [T7j, the derivatives 
of Y are completely determined by 0, which satisfies (6.15) in [17j. Let 
be given by (7.3) in [17], following the ffist paragraph in section 8.1 
in [17], we obtain a unique solution Y G to (15.11) . normalized to 
vanish at a fixed point on We denote such a.YhjY = ^{Z). 
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To prove estimates f l5.2p and (15.31) . by the Remark on page 365 in 
[17] and the proof following it, we know it suffices to show 



(5.4) \\Y\\c-^.c.<C 



|(i(T^||ci,c + ||^(Cl„ - C2n)||c° 



where da"^ = 1 — {dZy, ciy, C2u are derivatives of Ci, C2 with respect 
to V, u respectively. On the other hand, by section 9 in [17J, to prove 
(15.41) . it suffices to estabhsh an C^'" estimate of (p: 

(5.5) < C'IM^^||ci>- 

Therefore, in what follows, we will prove that there are positive numbers 
5 and C, depending only on cr°, such that (15.51) holds for any a satisfying 

I |(T° — 0"! |c2,c« < 5. 

We first recall the fact that is a solution to the second order elliptic 
equation (6.15) in [17] . For simplicity, we let 

(5.6) L,(0) = £(0^,0,), F^{da^) = C{ci,C2)-T, 

where £(0„,0„), £(ci,C2) — T are given as in (6.16) and (6.14) in [T7] . 
then (6.15) in [T7| becomes 

(5.7) LM + H„cp = F,{da^), 

where H^j is the mean curvature of X'^(§^) w.r.t X3 (note that our H 
here equals 2H in [17]). On the other hand, since we have chosen to 
be given by the integral formula (7.3) in [17], we know is a special 
solution to (15. 7p in the sense that is L^-perpendicular to the kernel 
of the operator L„{-) + (See page 359 in ^12]). For any a G A^^'", 
let Ker{a) denote the space of solutions ip to the the homogeneous 
equation 

(5.8) L^{^) + H^^ = 0. 

On page 360 in p/Tj, it was shown that Ker{a) is spanned by the 
coordinate functions of X3. 

Note that the coefficient of (15. 7p depends only on the metric a. 
Therefore, if a is close to 0"° in C^'", we know by Theorem 8.32 in fTO] 
that, to prove the C^'" estimate (15. 5p . it suffices to prove the following 
C° estimate 

(5.9) \\<f)\\co<C\\da^\\cn.., 

where C is some positive constant independent on a, provided a is 
sufficiently close to cr° in C^'°. 

Suppose (15. 9p is not true, then there exists {cXi} C which con- 

verges to cr° in C"^'"", {daf} C S^'°' with | |(icTj^| Ic-i.^^ = 1, and a sequence 
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of numbers {Ci} approaching +cx) so that the corresponding (pi (of 
Y = Yi) satisfies 

\\4>i\\co > Ci. 

Consider = |co, then satisfies 

(5.10) L^Mi) + 2H,^i, = m\-lF^Xd(T^). 

By Theorem 8.32 in [lOj, we conclude from fIS.lOp and the facts {ai} 
converges to in C^'" and H^CiUco = 1 that 

(5.11) \Mc^^^<C, 

where C is some positive constant independent on i. Now (15. lip imphes 
that C,i converges in to some ^ which is also in C^'". Moreover, 
ll^llc-o = 1. By (I5.10p . ,^ is a weak solution to the equation 

(5.12) L,o^ + H,o^ = 0. 

Since cr° G C^'", the coefficients of (I5.12p (given by (6.16) in [17]) are 
then in C^'", hence in C^'^. By Theorem 8.10 in [lOj, we know ^ G W^'^, 
hence in C^. Therefore, ^ is a classic solution to (I5.12p . i.e. ^ G 
Ker{a^). On the other hand, we know (pi, hence C,i, is L^-perpendicular 
to Ker{ai) for each i. Since {o"j} converges to a" in C^'" and {C,i} 
converges to ^ in C^, we conclude that ^ must be L^-perpendicular to 
Ker{a^). Hence, ^ must be zero. This is a contradiction to the fact 
||(^||(70 = 1. Therefore, we conclude that (15. 9p holds. 

As mentioned earlier, once we establish the C° estimate (15. 9p . we 
will have the C^'" estimate (15. 5p . Then we can proceed as in the rest 
of section 9 in [17] to prove (15.40 . hence prove (15.20 and (15. 3p . □ 

We note that the constants e and C in Lemma 15.11 indeed can be 
chosen as e = —2 and C = 2K, where K is the constant in Theorem 2' 
on page 352 in [17j. Therefore, by applying the exactly same iteration 
argument as on page 352-353 in [17], one concludes from Lemma [5.21 
that 

Lemma 5.3. Let cr° G TVI^'" be a metric with positive Gaussian curva- 
ture. There exists positive numbers 6, e and C , depending only on 0"°, 
such that for any a G TVI^'" satisfying 

\\cr^ — o"| |c2,Q < 6, 

if T E Ai'^'"' satisfying 

\\a — T\\(j2,a < e, 

then there is an isometric embedding Y G 8^'°" of (§^, r) in M.^ such that 
\\X — Y\\Q2,a < C||cr — r||(72,Q. 
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Here X G is any given isometric embedding of (§^, a). 
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